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APPROXIMATION  OF  PROCESSES  AND  APPLICATIONS  TO 


CONTROL  AND  COMMUNICATION  THEORY 
by 

Harold  J.  Kushner 


Abstract  and  Introduction 

Diffusion  models  are  useful  and  of  widespread  use  in  many  areas  of 
control  and  communication  theory.  The  models  are  frequently  used  for 
systems  that  are  not  quite  diffusions  but  are,  hopefully,  close  to  a 
diffusion  in  some  sense.  E.g.,  the  input  noise  might  be  'wide-band ' 
but  not  'white-Gaussian. '  Many  approximation  techniques  have  been 
developed  [it}— {40},  under  different  sets  of  assumptions.  The  typical 
results  are  of  a  weak  convergence  nature.  The  physical  process  x^( • ) 

is  parameterized  by  the  parameter  e,  and  one  tries  to  show  that  { xe  C * ) J 

V-  • 

converges  weakly  to  some  diffusion  x(*)  as  e  -*■  0.  The  limit  process 
x(*)  is  then  used  to  study  various  properties  of  x£(*)  for  small  p. 

If  the  system  involves  nonlinear  functions  of  the  input  noise,  or^lif 
the  noise  depends  on  the  system  state  or  if  the  system  dynamics  are  not 
smooth,  then  the  approximation  problem  is  harder.  Here,  we  discuss  a  set 
of  techniques  which  have  proved  to  be  quite  useful  for  a  variety  of  prob¬ 
lems  in  control  and  communication.  The  main  weak  convergence  theorems 
are  stated  and  discussed  in  Section  II.  Frequently,  in  applications,  we 
are  concerned  with  asymptotic  properties,  as  t  -*■  «  (for  small  e),  as 
well  as  with  weak  convergence.  Such  information  is  not  normally  provided 
by  the  weak  convergence  theory.  In  Section  II,  we  also  discuss  the  prob- 
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lem  of  approximating  functionals  on  the  'tail*  of  xG(#)  for  snail  e, 
by  such  functionals  on  the  'tail*  of  x(*)  (e.g.,  approximating  the 

measures  of  (xG(t),  large  t},  for  small  e,  by  an  invariant  measure  of 
x(*).  This  is  particularly  useful  in  problems  in  communication  theory, 
where  the  (say)  detection  system  is  often  supposed  to  be  in  operation  for 
a  very  long  time.  The  proofs  of  these  theorems  are  given  in  the  references. 

In  Sections  III  and  IV,  we  apply  these  theorems  to  two  systems  which 
are  of  frequent  and  basic  use  in  communication  theory,  but  which  seem  to 
be  quite  difficult  to  analyze  without  at  least  some  sort  of  formal 
diffusion  approximation  technique.  Other  applications  to  control  and 
communication  of  these  and  related  ideas  can  be  found  in  [9],  [11]-[14). 
While  there  has  been  widespread  application  of  diffusion  approximation 
methods  to  some  topics  in  physics  and  biology,  and  operations  research 
(e.g.,  to  queueing  theory),  applications  to  concrete  nonlinear  problems 
in  control  and  communication  theory  is  still  in  its  infancy.  There  are 
numerous  possibilities  for  other  applications;  e.g.,  to  synchronization 
systems,  robustified  filters  (where  some  nonlinear  function  of  the 
observation  is  used  in  lieu  of  the  observation),  to  adaptive  modulation 
systems  and  filters,  etc. 
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II.  CONVERGENCE  AND  APPROXIMATION  THEOREMS 

£ 

Weak  Convergence .  Suppose  that  the  system  state  x  (•)  satisfies 
the  differential  equation  xc  =  He(£c ,xc) ,  where  £e(*)  is  an  input  noise 
process  whose  bandwidth  (BW)  goes  to  00  as  e  -*■  0  (loosely  speaking), 
and  xe(t)  e  Rr,  Euclidean  r-space.  We  are  first  interested  in  showing 
that  (x  (•))  converges  weakly  in  D  [0,®)  to  some  diffusion  process 
x(*)»  defined  by  (2.1),  where  we  assume  that  the  martingale  problem  in 

Jr* 

D  [0,®)  associated  with  (2.1)  has  a  unique  solution  for  each  initial 
condition  x  =  x(0)  . 

dx  =  a(x)dt  +  a(x)dB  ,  B(-)  =  standard  Wiener  process  (2.1) 

It  is  possible  to  treat  problems  where  the  limits  are  jump-diffusions  as 
in  1 7 ]  -  [  8 ) ,  but  since  the  applications  in  Sections  III  and  IV  all  have 
diffusion  limits,  the  basic  theorems  here  are  specialized  to  this  case. 
Define  the  differential  generator 

A  =  l  a. (x)  3/3xt  +  y  l  a.  . (x)  3^/3x. 3x  .  ,  where  a(x)  =  (a^ . (x) }  =  o(x)o' (x)  . 

For  each  N  >  0,  let  bN(*)  denote  a  continuously  differentiable  function 

saiufyin^  bN(x)  =  1  for  x  e  =  {x  :  |x|  t  N),  0  £  bN(x)  S  1*  and 

N 

b^(x)  =  0  for  x  i  SN+1.  Let  A  denote  the  differential  generator  of 
N  N  N 

a  diffusion  x  (•)  with  coefficients  a  (•)>  o  (•)  equal  to  a(»).  o(*)> 

£  N  •  £  N 

resp.  in  S^.  Define  the  truncated  process  x  ’  (•)  by  x  = 

HLtr,t'.xe  *N)bN  (x&  ,N)  .  Then,  if  xc’^(.)  -►  x^(*)  weakly  in  Dr|0,<*>),  as 
t  ■*  0  for  each  N,  we  have  [8]  xc(*)  -*•  x(*)  weakly  also.  The  trunca¬ 

tion  is  used  as  a  technical  device  only,  in  that  allowing  us  to  work  with 
bounded  processes,  it  simplifies  the  proofs  and  the  calculations  in  the 


\ 
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applications  of  the  theorem,  although  it  makes  for  a  slightly  more 
complicated  theorem  statement. 

Let  denote  the  space  of  real  valued  continuous  functions  on 

T  A 

R  with  compact  support,  and  the  subspace  whose  mixed  a 

partial  t-derivatives  and  6  partial  x-derivatives  are  continuous.  Let 

(F^)  be  a  non-decreasing  sequence  of  o-algebras  with  FE  measuring 

(£e(s),  s  s  t).  Let  H  denote  the  class  of  real  valued  (progressively) 

measurable  (w,t)  functions  such  that  if  g(*)  6  H,  then  sup  E|g(t)|  <  ®, 

t 

E|g(t*6)  -g(t)|  -*-0  as  6  +  0,  and  g(t)  is  FE  measurable.  Let  Ee 

denote  expectation  conditioned  on  FE.  Following  [4],  we  say 

p-lia  f5(*)  =0  if  sup  E|f^(t)|  <  »  and  E|f6(t)|  +  0  as  6  +  0, 
5+0  t*0,6>0 

for  each  t.  Define  the  operator  A  with  domain  P(A  )  as  follows: 

g  c  J?(AC)  and  AEg(*)  =  q(*)  if  g(*)  and  q(*)  are  in  H  and 

p-lim  [(E®g(**«)  -g(  •)}/5-q(*)]  =  0.  Thus,  Ae  resembles  an  infinites- 
6+0 

imal  operator.  The  following  theorem  is  a  specialization  of  a  result  in 
[8],  which  in  turn  is  a  development  of  ideas  of  Kurtz  [4]. 


Theorem  1 .  Let  <*(•),  o(*)  be  continuous,  and  assume  the  above 
uniqueness  condition  on  the  solution  of  (2.1).  Fix  N.  For  each 
f(’)  «  ^o’3>  let  there  be  a  sequence  { *N(* ) }  e  H  such  that 


p-lim  jfe'N(-)  -  f(xe'N(.),-jl  =  0 

£+0 

p-lim  IaV’V)  -  (AN  +  ^-]ffxe'N(0,-)l  =  0 


(2.2) 


Then,  if  (xe,^(*)}  is  tight  in  Dr[0,=°)  for  each  N,  and  xc(0)  +  xQ 
weakly,  ( xe ( * ) )  converges  weakly  to  x(*)  (with  x(0)  =  xQ)  £S  t  +  0. 
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e  N 

Remark.  In  the  examples,  it  is  shown  how  to  get  {f  ’  (•))  in 

typical  cases;  the  method  is  also  discussed  in  [3],  [7],  [9],  [11]- [14]. 

2 

We  use  the  form  fe,N(t)  =  f(xe,N(t),t)  =  £  f^’N(t),  where  a 

i -0  or  1  ^ 

convenient  method  for  getting  the  perturbations  f?’  is  discussed  in 
Sections  III  and  IV.  In  the  applications  which  we  have  in  mind,  it  is 
convenient  to  prove  tightness  via  Theorem  2  below.  Let  denote  the 

f 

space  of  real  valued  continuous  functions  on  R  ,  with  compact  support. 

Theorem  2  [8].  Fix  N.  For  each  f(*)  in  a  dense  set  c  CQ 

which  contains  the  square  of  each  function  in  it,  let  there  be  a  sequence 

{fe’^(*)}  iji  W  such  that  fe,^(*)  e  0(AE),  and  for  each  real  T  >  0, 

c  N 

let  there  be  a  random  variable  Ml*  (f)  such  that 

Ptsup  |fE,N(t)  -  f  (xe,N(t))  |  5  a}  -*■  0  as  e  0  ,  each  a  >  0  , 

t*T 

sup  |A£fe,N(t) |  *  M5’N(f)  (2.3) 

tST  ‘ 

sup  P{ME,N(f)  i  K}  ■*  0  as  K  -*•  «  . 

€>0 

Then  {f(xe’N(*)}>  is  tight  in  D^fO,®)  for  f(*)  e  P  ,  and  {xe,N(*)) 
is  tight  in  Dr[0,®). 

Remark .  Typically,  P  -  but  with  the  time  dependence  sup 

e  N 

pressed,  and  the  f  '  (•)  are  constructed  as  they  are  for  Theorem  1. 

The  conditions  are  not  particularly  restrictive,  as  will  be  seen  in  the 
examples  below,  or  as  can  be  seen  from  the  applications  in  the  references. 

Discrete  Parameter.  Theorem  1  simplifies  slightly  in  the  discrete 
parameter  case.  Let  {t£}  denote  a  sequence  of  positive  numbers  tending 

to  zero  as  e  -*•  0,  and  suppose  that  the  random  sequence  (x^)  satisfies 

c  e  e  e  e  e 

xn+1  *  h  (£„»xn)»  f°r  some  suitable  measurable  h  (*.*)  and  random 
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xe*N  _  xe»N  hEfEe  xe,N)b  (xe,N'1 

Vl  xn  n  un’xn  JVxn 

and  define  xE(*)>  xe,^(«)  by  xe(t)  =  xe,  xE’^(t)  =  xE’^  on 


sequence  U*}.  Define  <xE'"}  by  xE^  =  xE'N  ♦  hE(C,xE’P‘)bM(xE’N) , 


n' 


n 


[nx  ,  nx  +  r  ).  Write  Ee  for  Ee  .  Then  for  f(*)  e  H,  we  now  define 
e  e  e  n  nx 

g  E 

A  f(nx£)  =  (Enf(nx£  +  xE)  -  f(nx£)]/T  .  In  the  application  of  Section  4, 

e 

x  =  e.  Theorem  1  can  be  now  rewritten  as: 
c 


Theorem  3  [8] .  Assume  the  conditions  of  Theorem  1 ,  but  where  (2.4) 
replaces  (2.2),  and  the  f  ’*  ( •)  are  constant  on  the  [nx^.nx^  +  t  ) 
intervals. 


sup  E|fE,N(nx  )  |  <  »  ,  sup  EjAefE,N(nx  )  |  <  00  , 
n,£  E  n, e 

E|fE'N(nxe)  -  f(xE,N(nx£),nTe) j  *0  (2.4) 

E|AEfE,N(nxe)  -  ♦  AN)f(xE’N(nxe)fnxe)t  +  0  , 


for  each  t  and  nx^  -*•  t  as^  e  ■*  0.  Then  the  conclusions  of  Theorem  1 
continue  to  hold.  (There  is  also  the  obvious  discrete  parameter 
simplification  of  Theorem  2.) 


Approximat ion  of  Asymptotic  and  Invariant  Measures.  Theorems  1  to  3 

yield  weak  convergence  of  (xE(*)}  to  x(*)  in  Dr[0,<”).  Frequently 

in  applications  we  are  more  interested  in  the  measures  of  xE(t)  for 

large  t  and  small  e.  Suppose  that  x(*)  has  a  unique  invariant 

measure  w(*)-  In  practice  this  measure  is  often  used  as  an  approximation 

to  the  'asymptotic'  measures  of  xE(t).  In  particular,  it  is  of  interest 

£ 

to  show  at  least  that  the  measure  of  x  (t)  converges  in  some  sense  to 
v(*)  as  t  -*■  ®,  £  0  in  any  way  at  all.  Weak  convergence  does  not 

yield  such  information  directly.  But  weak  convergence  together  with  an 
'averaged  Liapunov  function'  technique  and  some  assumptions  on  x(»)  can 


yield  the  desired  result  [15].  Here,  we  cite  some  results  which  will  be 
used  in  the  examples.  The  basic  assumptions  are  (A1)-(A4),  and  Theorem  4 
is  the  basic  convergence  theorem.  Conditions  guaranteeing  (A4)  will  be 
given  after  the  statement  of  Theorem  4. 

Theorem  4  requires: 

A1 .  x ( *)  is  a  Feller  diffusion  process  with  continuous  coefficients  and 
a  unique  weak  sense  solution  on  [0,”)  for  each  x(0)  =  x. 

A2.  x(*)  has  a  unique  invariant  measure  p(*)  and  P^txft)  c  •}  con¬ 
verges  weakly  to  u ( • )  for  each  x ,  as_  t  •*•«■> .  The  convergence  is 

uniform  in  compact  x-sets;  i.e.,  for  each  f(*)  in  the  space  of 

continuous  bounded  functions  on  Rr,  E  f(x(t))  -*•  E  f(x(0)) 

uniformly  in  x  in  compact  sets,  as  t  ->•  »>. 

A3.  xe(>)  -*■  x(*)  (initial  condition  x(0))  weakly  if  xe(0)  -*■  x(0) 

weakly  in  DT [ 0 , °°) . 

A4.  There  is  an  eQ  >  0  such  that  (xE(t),  0  <  c  $  eq,  t  *  0}  is 
tight. 


Theorem  4  [15] .  Assume  (Al)  -  (A4) .  Then  for  each  integer  m, 
real  T  <  °°,  and  bounded  continuous  f(*)  and  5  >  0,  there  are 
tgCf.^)  <  °°  and  e0(f,6)  >  0  such  that  for  t  z  tQ(f ,<5)  and 
e  s  eQ(f,5) ,  and  any  sequence  {xe(')}  which  converges  weakly  to 
x(*)  and  T  }  4.  H,  i  =  1,  ....  m, 

|  Ef  (xe(t+Ai) ,  ism)  -  E  f(x(A.),  i  S  m)  |  <6 

Let  (xe(-) ,  £e(*))  be  Markov  and  have  an  invariant  measure  vc(*) 
with  x-marginal  u£(*).  Replace  (A4)  b^.:  There  is  a  sequence  T^  (which 
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might  tend  to  »  a!5  e  -*■  0,  and  can  depend  on  the  initial  condition) 

such  that  (A4)  holds  for  t  5  T  .  Let  sup  E|££(t)|  <  »,  where  the 

e  t>0, e>0 

£ 

expectations  are  with  respect  to  the  stationary  measure  v  (•)•  Then 


Remarks .  In  the  proof  of  the  last  assertion  of  the  theorem,  we  only 
need  prove  that  (p£(*)}  is  tight,  and  the  given  tightness  condition  is 
used  for  this.  In  applications,  it  is  often  possible  to  prove  a  result 
such  as  lim  E  |x£(t)|  s  K,  where  x  is  a  bounded  random  variable  and  K 

t-**>  x 

does  not  depend  on  x  for  small  e.  This  implies  the  first  sentence  of 
the  replacement  for  (A4)  in  the  theorem.  See  also  Theorem  (>  in  Section  III. 


A  criterion  for  (A4) .  The  tightness  (A4)  can  be  proved  if  certain 
stability  assumptions  (of  the  'recurrence'  type)  are  made  on  the  limit 
x(-);  in  particular,  if  there  is  a  Liapunov  function  V(-)  of  the  sort 
frequently  used  to  prove  recurrence  for  x(*)-  An  'averaged'  form  of 
V(-)  is  used;  the  averaged  function  is  obtained  similarly  to  the  way 
the  perturbation  f£(*)  to  f(*)  is  obtained  in  applications  of 
Theorems  1  to  3.  Owing  to  the  mixing  condition  (Bl)  and  to  the  smoothness 
conditions  (B2) ,  (B4),  below.  Theorem  5  is  too  strong  for  many  app'ica- 
tions.  The  conditions  are  weakened  in  Theorem  6  (Section  III).  Further 
comments  and  developments  appear  in  [15]. 

Let  us  specialize  to  the  form 

x£  =  F(xe,£e)/e  +  G(xc,£e)  +  G(x£)  ,  (2.5) 

where  £e(t)  =  £(t/e^)  for  some  stationary  process  £(•)•  Let 
EF(x,£)  =  EG(x,S)  =  0.  This  noise  scaling  is  a  common  way  of  getting  a 
wide  band  noise  process,  with  'bandwidth'  parameter  e.  Under  various 
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sets  of  conditions  ( [5] ,  [7] , [14])  the  differential  generator  of  x(*)  is 
given  b> 


Af(x)  =  f ' (x)G(x)  +  f  eff ' (x)F(x,C(t))] '  F(x,C(0)}dt  .  (2.ba) 

x  J0  l  *  Jx 

If  £(•)  is  Markov  and  F(*,*)  not  smooth,  then  we  use  the  representation 

Af(x)  =  f^(x)G(x)  +  |  E [^5 (0) f^[x) F (x, C(t)}  ’  F(x,C(0))dt  ,  (2.6b) 

if  the  derivatives  exist  for  t  >  0  and  are  integrable. 

We  will  require  (B1)-(B4)  in  Theorem  S.  The  constant  K  might  vary 
from  usage  to  usage.  These  conditions  as  well  as  the  extensions  to  be 
discussed  in  Theorem  6  below  fit  many  common  applications. 


B1 .  £(•)  is  a  bounded,  right  continuous,  stationary  j>-mixing  process 

[16]  with 


P°  h 

'  4>  (t) dt  < 


0 


B2.  F(*,")>  G(*,*)  and  G(*)  aTe  continuous,  Rr  valued  functions 

whose  growth  (as  |  x  |  °°)  is^  0(|xj).  The  partial  derivatives  of 

F(*,£)  up  to  order  2  (and  of  G(*,£)  up  to  order  1)  arc  bounded 
uniformly  in  x,£,  and  EF(x,£)  =  0  e  EG(x,0. 


B3.  There  is  a  diffusion  process  x(*)  with  differential  generator  A 
defined  by  (2.6),  and  which  satisfies  (A1)-(A2).  There  is  a  contin- 
uous  Liapunov  function  0  $  V(x)  -*■  «  as  |x|  -»  and  a  X  and 

aQ  >  0  such  that  AV(x)  <:  - a ^  for  x  i  =  (x:V(x)  £  X^}. 

The  partial  derivatives  of  V ( • )  up  to  order  3  are  continuous . 

B4 .  There  are  constants  K  such  that,  uniformly  in  x , 5 , 
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|V'(x)G(x,C)|  ♦  |v;(x)F(x.O|  S  (1  ♦  V(x)) 

|(v^(x)F(x,0)'  F(x,Ol  *  K(l  ♦  V(x)) 

|(V’(X)G(X,C))^  U(x.O|  s  K(l  ♦  | AV(x)  | ) 

for  U  =  F,G,G  . 

|(v^(x)F(x,o);  U(x.O|  ?  K(l  ♦  |AV(x)  I)  ,  U  =  G, 

|[(v;(x)F(x.O)'  F(x,£)]’  U(x,C)|  S  K(l  ♦  |AV(x)|) 

U  =  F.G.G  . 

Theorem  5.  Under  (Bl)  -  (B4)  and  the  tightness  of  {xE 
condition  (A4)  holds . 


(0)}, 
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III.  EXAMPLE  1.  A  PHASE  LOCKED  LOOP  WITH  A  LIMITER 

The  phase  locked  loop  (PLL)  is  a  basic  device  used  for  synchronization 
in  conmunications  systems;  in  particular,  to  estimate  the  phase,  frequency 
and  certain  'timing'  data  of  the  incoming  signal.  In  this  example,  we 
treat  a  simple  PLL,  but  with  a  commonly  used  (and  hard  to  analyze)  nonlin¬ 
earity.  The  circuit  and  definitions  of  some  terms  are  given  by 
Figure  1.  The  VCO  (voltage  controlled  oscillator)  is  an  oscillator  which 
oscillates  at  a  frequency  whose  deviation  from  a  given  central  frequency 
is  proportional  to  its  input  voltage.  First,  we  describe  the  input 
noise  and  the  parametrization,  and  then  simplify  the  model  slightly.  Then 
Theorems  1  to  4  will  be  applied.  The  noise  model  used  is  chosen  for  ease 
of  presentation,  and  because  the  technical  details  of  proof  [13]  are  not 
too  hard.  Further  details  of  this  example  can  be  found  in  [13],  which 
also  contains  analyses  of  several  other  phase  locked  loop  type  devices, 
with  either  nonlinearities  or  other  features  which  seem  to  require  a 
robust  diffusion  approximation  method,  such  as  the  one  presented  here. 

Refer  to  Figure  1.  The  object  is  to  track  the  unknown  and  time  varying 
phase  6(*)  of  the  input  signal.  Let  6(*)  be  continuously  differen¬ 
tiable  here.  With  not  much  extra  trouble,  various  random  process  models 
can  be  used  for  both  6(*)  and  also  for  Aq  (which  is  a  constant  here). 

The  system  operates  with  a  high  central  frequency  and  a  noise  bandwidth 
which  is  wide,  but  small  relative  to  the  central  frequency.  Let  (q^) 
be  a  sequence  of  positive  real  numbers  tending  to  zero  such  that  e/q£  0 
as  c  -*■  0.  Let  (4>^,z^(-)  ,i=l,2}  be  mutually  independent  with  the  4>. 
uniformly  distributed  on  [0,2ir],  and  the  z^(*)  Gaussian  processes  with 
spectral  density  S(w),  and  unit  variance.  Define  z^(t)  =  z^(t/^2)  and 
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SE(t)  =  o[z*(t)cos(wgt  +  +  2®(t)sin(GjQt  +  $2)  ]/qc  ,  (3.1) 

where  o»q  is  the  input  (and  central  VCO)  frequency.  Then 
j  [Sfo^u-uJ))  *  S  (q^ (oi+uJq) )  ]  =  S£(*)  is  the  spectral  density  of  £e(0- 

0  2 

Let  Wq  =  w^/e  •  Then  S£(*)  *s  t*'e  desired  parametrized  wide  hand 
form.  With  no  loss  of  generality,  we  set  =  0.  The  matrix  D  in 
the  filter  in  Fig.  1  is  stable. 

A  gain  of  roughly  the  form  L£  =  L/q£  in  Fig.  1  (either  before  or 
after  the  filter)  is  needed  because  if  q^L^.  -*•  0  as  e  -*■  0,  then  the 
input  to  the  VCO  will  go  to  zero  weakly  as  e  -*■  0.  If  q  L£  'k  "  as 
e  -*■  0,  then  the  output  will  diverge  to  infinity.  The  scaling  is  consis¬ 
tent  with  heuristic  methods  used  for  analyzing  such  systems.  Let  sign  (0) 
be  any  number  in  [-1,1].  Let  z^(«)  he  Gauss-Markov;  in  particular  let 

z.(t)  =MZ.(t),  where  dZ.  =  AZ.dt +  Bdw.,  and  (w.(*),  i  =  1,2)  are 
1  1  1  i  x'  1 

independent  standard  Wiener  processes  and  A  a  stable  matrix. 

We  now  simplify  the  model  slightly.  The  output  of  the  multiplier 
can  be  written  in  the  form 

[z^(t)(cos0c  +  cos(2<DQt  +  9e)}  +  z^(t)  (sin(-6E)  +  sin(2wgt  «■  0f'))  ] 

A„ 

+  ~  [sin(6E  -  6C)  ♦  since""  +  §E  +  2u>pt)  ]  .  (3.2) 

If  we  proceeded  with  this  'output,'  the  terras  involving  2w(^t  would 
have  no  effect  on  the  limit,  and  for  notational  simplicity  here  we  drop 
them  at  this  point.  In  fact,  it  is  common  engineering  practice  to 
assume  that  the  multiplier  acts  as  a  filter  which  eliminates  these 
same  terms  involving  2w^t .  While  one  must  be  careful  in  using  this 
'filtering'  idea,  since  the  system  is  nonlinear  and  time  varying  and  the 
properties  of  0£  arc  not  known  a  priori  for  small  e  ,  these  terms  do 


not,  in  fact,  affect  the  limit  process  (as  can  be  shown  by  retaining  them 

throughout  the  analysis).  Let  L=1  (absorb  it  into  the  other  parameters). 

The  main  result  is  the  following:  (ve ( •)  ,0e( •) }  converges  weakly 

to  the  diffusion  v(*).fl(*)  defined  by  (3.3),  where  B(*)  is  a  standard 

2 

Wiener  process  and  p(t)  =  Ez^(t)2^ (0)/Ez^(t)  (the  stationary  measure  is 
to  be  used  here).  If  P(t)  =  exp  -a|t|,  a > 0,  then  =  2fcn2/a  [11], 
Section  6. 


dv 

0 

»  IDV  ♦  -£  H 

/2/t r  sin(0-0)]dt  ♦  H  aQdB 

(3.3a) 

<  a> 
-o 

=  Cvdt  ,  0 

given. 

(3.3b) 

oi  =  4  I  [P(z.(u)  >  0,  z.  (0)  >  0}  -  P(z.(u)  <  0,  z.(O)  >  0}]du 

u  In  1  1  1  1 

sin  ^p(u)du 

If  we  consider  the  standard  PLL,  where  the  limiter  and  gain  are 

replaced  by  simply  a  unity  gain,  then  the  limit  process  is  defined  by 


dv  = 

[Dv  ♦  H  y  sin(0-§) ]dt  +  c^HdB  , 

de  = 

Cvdt  , 

(3.4) 

where 

In  this  latter  case,  the  analysis  is  much  simpler  and  the  Gaussian  assump¬ 
tion  can  be  weakened. 

For  small  o,  the  system  with  the  limiter  is  preferable  to  the  system 
without  the  limiter,  and  conversely  for  large  a.  This  interesting  and  very 
useful  result  has  been  verified  also  by  simulations. 
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In  order  to  use  the  limit  results  (3.3)  or  (3.4)  to  get  probability 

estimates  in  any  particular  application,  we  must  estimate  the  values  of 
2 

nig,  o  ,  p(*)  for  that  application.  This  can  often  be  done  via  measure¬ 
ments  on  the  system,  and  is  briefly  discussed  in  [14]. 


Application  of  Theorems  1  and  2.  Dropping  the  terms  in  (3.2)  which 
contain  2u>Et,  the  input  to  the  filter  in  Fig.  1  is  uE (t ,0E (t) ,0 (t)) , 
where 

A 

uE(t,0,0)  =  sign[^-  (zE(t)cos0  -  zE(t)sin§)  +-^sin(9-0)]  . 

Also 


Ve  =  Dv£  +  HEue  +  H(ue  -  Eue) 
0£  =  CvE  ,  (ve,0E)  =  xE  , 


(3.5) 


Eue(t,0 ,6)  =  'fijv  sin(0-0)  +  0(qe)  . 

Throughout  expectations  and  conditional  expectations  are  over  the  zE(*) 
only.  The  0E(t),  0(t)  are  considered  to  be  parameters  when  taking 
expectations. 

-  2  3 

Now,  apply  Theorem  1  to  a  test  function  f(*)  c  (JQ’  .  To  be 

c  N 

consistent  with  Theorems  1  and  2,  we  should  work  with  (x  ’  (•))»  for 

large  N.  We  will  give  only  a  rough  outline  of  the  procedure  and  the 

notation  is  simpler  if  we  drop  the  N-affix  and  the  b^( •)  (unless  men- 

e  N 

tioned  otherwise).  The  given  estimates  are  actually  valid  for  (x  ’  (•)) 

£ 

for  each  N,  and  not  necessarily  for  (x  (•)},  but  this  is  unimportant 
for  application  of  Theorems  1  and  2.  Now,  applying  AE  to  f(*l,  and 
writing  xE(t)  =  xG,  yields 
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A£f(xc,t)  =  ft(x£,t)  ♦  fg(xt.t)CvE 

+  fy(xe,t) [Dve  +  HEuf  (t  ,0E,0(t)) ]  ♦  f^(xe,t)H6uE (t,§E,0(t))  , 

where  6uE(t,0,0)  =  uE(t,0,0)  -  EuE(t,0,0).  Only  the  'noise  term' 
f^H6ue  needs  to  be  averaged  out.  These  so-called  averaging  operations 
follow  the  scheme  in  [3],  [7]  and  they  yield  the  perturbations  f?  to  f 
required  by  Theorems  1,  2.  (See  also  [9],  [12] -[15] ,  for  applications 
and  illustrations  of  this  averaging  idea.) 

Define  the  first  perturbation  fE(t)  =  fE(xE(t),t)  by 

f£(x£,t)  =  f  dsE£f^(xt,t+s)H6ue(t+s,0e,0(t)) 

r  .  (3-b) 

=  <L  I  dsEEf ' (xE ,t+q2s)H6uE (t+q2s ,0E ,0(t))ds 

t  l  V  E  E 


Note  that  the  integrand  of  the  first  integral  of  (3.6)  at  s  =  0  is 
just  the  'noise  term'  which  we  wish  to  average  out.  Owing  to  the  sign 

function  in  6u  ,  and  to  the  fact  that  the  operation  A  involves  a 

differentiation,  it  is  convenient  to  write  Ee5ue  as  follows.  Define 
[t+s]  =  [zE(t+s)cos0E  -  zE(t+s)sin0e  +  — sin(0-0e)] .  The  distriK;t  ion  of 
[t+s]  conditioned  on  (zE(u),  uj  t,  i  =  l,2)  is  N(m£(s),  a^(s))  ,  where 


?  -  Anq 

m£(s)  =  p(s/q£)  [zE(t)cos0E  -  zE(t)sin0E]  + — sin(9-0e) 

o^(s)  =  1  -  p2(s/q2)  . 

y  O')  . 

Then,  using  the  notation  dN(m,c  )  =  d£[exp-(£-m)  /2cj  ]//2iT  o,  we  have 
EE6uE(t+s,0E,0(t)) 

=  “  |<”(sign  5)  [dN(me(s)  ,°2(s))  -  dN(-^  sin(0(t) -0E)  ,l)  ]  .  (3.7) 
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It  can  be  shown  that  f£(*)  e  P(Ae),  and  that 


Ifjct) I  =  0(q£) [1  +  | z£(t) I ]  ,  (3.8) 

and  (writing  xe(t)  =  x£,  and  letting  I  denote  the  integrand  of  the 
first  integral  in  (3.6)) 


Aef£(xe,t)  =  -f^(xe,t)H6ue(t,6e,6(t))  +  £  ds(E£I)g§£ 

+  ds(E£I)00(t)  +  ds(E£I)’v£  . 


(3.9) 


In  (3.9),  the  representation  (3.7)  is  used  for  Et6u  ,  so  all  derivatives 

are  taken  with  respect  to  parameters  in  the  normal  density  function.  The 

first  two  integrals  on  the  right  of  (3.9)  are  bounded  by  the  right  side 

2 

of  (3.8)  (to  see  this,  change  variables  s/q£  s) ,  and  the  last  term 
equals  (3.10)  modulo  a  term  which  is  bounded  by  the  right  side  of  (3.8). 
In  (3.10),  [t+s]  denotes  the  term  defined  below  (3.6). 

dsH'fvv(x£',t+s)H(E£sign[t+s]  -  E  sign  [t+s])  (sign  [t]-  Esign  [ t ] ) 

=  kG (t ,x£)  (3.10) 

The  term  kc  is  neither  negligible  nor  part  of  Af(xe,t)  and  must 
be  averaged  out.  To  do  this,  we  define  the  second  perturbation  function 
f£(t)  =  f£(t,x£(t)),  where 

f£(t,xe)  =  £  dx[E£ke(t+T,x£)  -  EkE(t+x,x£)]  . 

It  can  be  shown  that  |f£(t)|  =  0(q£)ll  +  |zc(t)|2]  ,  that  f£(0  *  J>(AL) 
and  that  (again  writing  x£  =  xE(t)) 

Aef2(t,xe)  =  -k£(t,x£)  ♦  Ek£(t,x£)  +  error  term  , 


\ 


(3.11) 
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where  |error  term|  *  0(qe)[l+  |zc(t)|^].  In  applying  Ae  to  f!j(*)  we 
use  a  representation  of  the  type  used  in  (3.7)  for  the  conditional  expec¬ 
tations  and  expectations,  so  that  the  derivatives  are  taken  only  with 
respect  to  parameters  in  the  normal  density  functions.  Finally,  it  can 
be  shown  via  the  technique  in  [11,  Section  6]  that  Eke(t,x)  - 
H'fvv(x,t)HoQ/2  0  uniformly  in  bounded  (x,t)  sets  as  c  0. 

Now,  let  us  summarize  the  above  calculations,  and  reintroduce  the 
superscript  N  on  x  1  (•)  only.  The  stated  bounds  on  |fE(*)|, 

| fE( •) -f (•) I ,  and  on  the  error  term  in  (3.11)  and  on  the  first  two 
integrals  on  the  right  side  of  (3.9)  all  hold  for  each  N.  Now  Theorem  2 

implies  tightness  for  {x£,N(*)>  for  each  N,  and  p  -  lim[fE( • ) -f (xE *N( •) , •) ]  =  0 

-e  e-H) 

The  expressions  given  for  AEfE(xE,t)  above  equal 

;e .£ ,  e,N  c,N  ,  e 

A  f^x  ,t),  if  x  and  x  are  in  SN>  Thus, 

p  -  lim[Aefe  (x£,N(  •) ,  •)  -  +  A)f(xE’N(.),0]bN(xE’V))  =  0  ,  (3.12) 

£“K) 

where  A  is  the  differential  generator  of  the  process  (3.3),  and  we 
conclude  that  (3.3)  is  the  weak  limit  of  (vE( •) ,0E( •)  }  if  (vE(0) ,0E(O) } 
converge  weakly  to  (v(0),9(0)}.  Further  details  on  this  and  on  similar 
problems  are  in  [11],  [12],  and  [14]. 

Approximate  invariant  measures  for  (3.5).  Since  the  noise  zE(*)  is 
unbounded.  Theorem  5  cannot  be  applied,  but  there  is  a  result  similar  to 

Theorem  4  which  is  useful.  Let  8(t)  =  0^,  a  constant.  We  interpret  both 

A  £  * 

9  (•)  and  0 ( •)  modulo  2n,  so  they  are  always  bounded.  Also  conditions 
(A1)-(A3)  hold.  The  main  problem  is  in  showing  that  (vE(*)»  tjO,  e  small} 
is  tight.  In  particular,  we  want  to  show  that  (eE(») ,vE(*))  =  xe(*) 
has  an  invariant  measure  mE(*)  for  small  e,  and  that  the  v-marginals 
(ye(*)}  of  (mc(*)}  are  tight. 
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There  is  a  useful  'averaged  Liapunov  method'  which  is  similar  to 
Theorem  5,  but  where  the  noise  is  allowed  to  be  unbounded,  and  the  con¬ 
ditions  are  tailored  to  a  class  of  cases  which  occurs  frequently.  For 
motivation,  we  first  consider  the  present  case.  For  some  positive 
definite  and  symmetric  P,  let  V(x)  =  v'Pv  be  a  Liapunov  function  for 
v  =  Dv,  and  let  X.  denote  the  differential  generator  of  (3.3a).  Then 
there  are  y  >  0,  K  <  <*>  such  that  JfcV(x)  £  -yV(x)  ♦  K.  An  averaging 
method  can  now  be  applied  to  V( - ) ,  to  yield  a  perturbed  Liapunov 
function  VE(*),  which  in  turn  is  useful  for  proving  the  required 
tightness,  via  a  method  which  resembles  those  used  for  'Liapunov  function' 
proofs  of  recurrence  of  strong  Markov  processes.  Actually,  since  AE 
cannot  be  applied  to  unbounded  functions,  the  averaging  is  done  on  and 
the  technical  conditions  are  introduced  on  the  truncated  Liapunov  function 
defined  by  VM(x)  =  V(x)bM(v) ,  where  bMC‘)  is  the  truncation  function 
defined  earlier. 

The  perturbed  or  averaged  truncated  Liapunov  function  VE(t)  = 

VE(xE(t),t)  is  obtained  by  perturbing  V^(vE(t)),  in  exactly  the  same  way 
that  we  perturbed  f(xE,N(t),t)  to  get  fE  (xE,N(t) ,t)  =  fE(t),  except 

that  here,  we  use  the  original  process  xE(#)  and  not  the  truncation 

e,N,  , 
x  CO- 

In  more  generality,  the  technique,  assumptions  and  result  are 
formalized  as  follows.  We  suppose  that  xE  =  HE(xE,£E)  takes  the  form 
(2.5)  and  that  £E(t)  =  £(t/c^).  (In  the  example  of  this  section,  q^ 
is  used  in  lieu  of  e.)  Suppose  that  for  some  >  0,  VE(*)  t  J?(AC) 

*"*  C  “  c 

for  e  $  tQ.  Suppose  that  there  are  random  variables  £  (t),£  (t), 

integers  p,q,  and  functions  V(*),V(»)  satisfying  (3.13).  For  the 

first  two  lines  of  (3.13),  let  x  e  S^  =  (x  :  |x|  *  M) .  Let  A  be  defined  by  (2.6). 
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AevJ(x,t)  =  AV(x)  ♦  0(e)  (l  +  V(x))  +  0(E)£E(t)V(x,t) 

Vj(x,t)  *  VM(x)  ♦  0(e)(l  +  V(x)}  +  0(e)rCt)V(x,t)  (3 

sup  E|5e(t)|p  <  “  ,  sup  E | (t) | q  <  ® 

t,e  t,  e 

|V(x,t)|p/p_1  =  0(v{x))  ,  |V(x,t)|q/q_1  =  o(V(x))  ,  for  large 

We  also  need  (C1)-(C4). 

Cl.  G(«).  F(*,*)»  G(*,*)  are  measurable  and  are  0(|x|)  for  large 
|x|,  uniformly  in  bounded  5-sets. 

C2.  For  the  given  sequence  (xE(0)},  sup  Ev(xe(0))  <  ®. 

e*e0 

C3.  sup  E|5(t)|  <  For  small  e,  (xE(*) ,£E(») }  and  £(•)  are 
Markov-Feller  processes  with  right  continuous  paths  and  homoge¬ 
neous  transition  functions. 

C4 .  0  *  V(x)  -*■  ”  as^  |  x |  and  AV(x)  $  -yV(x)  for  some  y  >  0 

and  large  |x| . 

Theorem  6  [15].  Assume  (C1)-(C4),  (A3),  (B3) ,  (3.13)  and  the 
conditions  above  (3.13).  Then  there  is  an  >  0  such  that  for 
e  s  Ej,  (xE(*)»  CE(*))  has  an  invariant  measure  mE(*)-  The  x- 
marginals  (yE(*)}  of  any  such  sequence  of  invariant  measures 
converge  weakly  to  u(’)  as^  e  -*■  0. 


.13) 
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Application  of  Theorem  6  to  Example  1.  Let  6(t)  =  6(0).  Since 
6(*)  and  0E(*)  are  bounded  by  2n,  we  need  only  let  V(0  depend  on 
v.  Use  V(x)  =  v'Pv,  and  q£  in  lieu  of  e.  Then  we  can  get  the  form 
(3.13)  where  p  =  q  =  2,  V(x,t)  =  0(|v|  +  1),  V(x,t)  =  0(|v|  +  1)  and 
both  CE(t)  and  |£(t)  are  bounded  by  o(l  +  |z£(t)j3).  Then  the 
theorem  implies  that  (x£(*) ,  ££(*) )  has  an  invariant  measure  for  small 
e  >  0,  and  that  the  x-marginals  converge  to  u(*)>  the  unique  invariant 
measure  of  x(«)  =  (v(-).e(O),  as  e  -*■  0.  This  justifies  the  use  of 
the  stationary  measure  of  (3.3)  as  an  approximation  to  the  stationary 
measures  of  the  system  of  Fig.  1,  for  small  enough  e,  and  when 
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IV.  EXAMPLE  2.  A  DIGITAL  PHASE  LOCKED  LOOP  (DPLL) 

Consider  the  digital  signalling  problem  where  a  random  sequence 

{s  }  is  transmitted.  The  received  signal  is  s(t)  +  noise  (t)  =  y_(t) , 
n  1 

where  s(t)  =  sn  in  [nT  +  5Q,nT  +  T  +  6^)  .  The  time  T  is  the  symbol 

interval  and  6^  is  unknown.  For  detection  with  an  acceptably  low  error 

rate,  a  very  good  estimate  of  is  needed,  and  a  DPLL  system  is  used 

to  provide  a  sequence  of  estimates  of  6^.  See,  for  example,  the  systems 

in  [17].  Here  we  deal  with  a  specific  simple  (but  important)  case.  Let 

s  =  ±A_,  An  >  0,  where  (s  )  is  i.i.d.  and  P(s  =  A_}  =  1/2.  Let  5 

n  0  0  n  n  0  n 

denote  the  nth  estimate  of  5.,  define  X  =  (5  -  6 _ ) /T .  In  the  study  of 

0  n  n  0 

the  algorithm,  the  exact  value  of  6^  is  unimportant,  so  w.l.o.g.,  set  6q  =  0. 

The  particular  DPLL  studied  will  now  be  defined.  It  was  chosen 
because  variations  of  it  are  used  frequently  [17],  and  rigorous  analysis 
via  currently  used  techniques  in  communication  theory  is  very  hard.  The 
diffusion  approximation  method  used  here  involves  scalings  which  are  con¬ 
sistent  with  those  used  currently  in  communication  theory  (explicitly  or 

implicitly),  and  seems  to  be  a  robust  and  systematic  tool  for  this  type 

(* 

of  problem.  Let  noise(*)  =  ip_(’)>  where  w_(t)  e  i|>  (s)ds  is  a 

l  *  1 0  1 

2  2 

Wiener  process  with  variance  o^.t.  The  variance  o‘  must  depend  on  T 
(for  small  T)  if  the  problem  is  to  be  meaningful.  In  any  particular 
case,  of  course,  would  have  to  be  determined  from  the  problem  data. 

2  /v 

To  get  the  scaling  of  oT,  suppose  that  6=0  and  that  the  statistic 

rp  i  n 

y  =  sQT  ♦  |  i|»T(s)ds  (the  integral  of  the  observation,  over  an  interval 
of  the  same  width  as  the  symbol  interval)  is  used  to  estimate  sQ(=  ±A0) 
via  a  likelihood  ratio  test.  But, 
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g  (A  ,  A  )  =  e  (A  .  ,  A  )/T  =  |(1-A-A  ,)s  +  (A  +  A  )s  ,  +  W(n+1+A  +  A  )-W(n+A+A  .) 
n-1  ir  nv  n-1  nJ  '  n-1  n  n  n+1  n  n-1' 


-|(A-An  l)sn+  (1-A+An)sn+1  +W(n+2-A  +  An)  -W(n+1-A+Xn_1)|  .  (4.2) 


We  can  use  W(t)  instead  of  wT(tT)/T,  since  the  latter  process  is  a  Wiener  pro- 

2 

cess  with  variance  a  t.  Finally,  with  adjustment  parameter  c  >  0,  we  write 

A  as  Ae  and  let  {Ae}  be  defined  by  the  recursive  algorithm  (the  DPLL) : 
n  n  n  1  b 


X  .  =  \  +  eg  (A  , , A  ) 

n+l  n  n-1’  n' 


e  >  0 


Normally,  the  adjustment  parameter  e  depends  on  T.  Since  we  are 
concerned  with  tracking  over  real  time  intervals  (n  :  nTsJt),  all  real  t, 
e  should  be  ~  (constant)T  for  small  T  for  otherwise  (smaller  order 
of  T) ,  the  sequence  (A^J  moves  too  slowly,  or  (larger  order  of  T)  is 
excessively  sensitive  to  the  noise.  Let  Aq  =  0(/e),  for  otherwise,  the 
system  (4.3)  will  not  be  able  to  improve  the  estimate  for  small  e. 

Define  UE  =  AE//fF ,  and  define  Uc(t)  =  UE  on  [ne,ne+c) .  Using 
parameters  A, A'  (in  lieu  of  A^  j.A^),  define  g(A,A')  =  Egn ( A , A • ) ,  and 
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set  £E(XE  ,,XE)  =  g  (XE  ,,X£)-g(XE  ,,X£), 
n  n-1  n  6n  n-1  n  n-1  n 


Then 


Cl  ■  Un  *  4  rt  C'n-l’O 


ue  +  eq  (XE  , ,X£) 
n  ^e  n-1  n 


(4.4) 


Define  U£’^,UE'^(*)  as  xE,N(*)  was  defined  in  Section  II.  In  parti- 

,  ,.e,N  ,,e,N  ,,e,N  ,e,N.,  ...e.N.,  .  ,e,N  r- .. e.N 

cular,  U  ,  =  U  +  eq  (X  ’  X  )b.,(U  )  ,  where  X  =  /e  U  is 

’  n+1  n  Me  n-1  n  Nv  n  n  n 


used.  There  is  a  0  >  0  such  that  -8  =  (d/dX)g(X,X) ) 
can  be  written  as 


X=0  ’ 


Equation  (4.4) 


f  .  =  UE  -  0UE  +  /F  CE(Xe  „Xe)  +  evE  , 

n  +  1  n  n  n  n-1  n  n 


(4.5) 


where  vE  =  0(jxE|2+|xE  |^+lll£-UE  ,1),  and  similarly  for  the  (Ur,N) 
n  n1  1  n-1 1  1  n  n-1 1  n 

equation.  The  main  result  is  that  if  UE  converges  weakly  to  a  random 
variable  U0,  then  (llE(*)}  converges  weakly  to  !)(•)»  where 


dU  =  -0Udt  +  vdB,  U(0)  =  U 


0  ' 


v  =  2E(gn+1(0,0)  -  g(0,0)J[gn(0,0)  -g(0,0)] 


+  E[gn(°,°)  -1(0,0)]  ,  any  n  *  1  . 


(4.6) 


£ 

If  the  (v  }  were  carried  through  in  the  calculations,  they  would 
n 

contribute  nothing  to  the  limit,  so  for  notational  simplicity  here,  we 

F.  N 

drop  them  from  (4.5)  (and  from  the  equation  for  (IT’  })  now. 

The  representation  (4.6)  is  useful  for  calculating  the  statistics 
of  the  DPLL  (4.3)  when  the  adjustment  rate  e  is  small,  say  e  -T, 
where  the  symbol  interval  is  small.  In  any  case,  rough  qualitative 
properties  and  parametric  dependencies  can  be  obtained.  We  do  not  know 
how  small  e  must  be  for  (4.6)  to  be  a  good  (scaled)  approximation, 
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although  simulations  on  related  s/stems  suggest  that  the  range  is  within 
reason  for  practical  systems. 


Application  of  Theorem  3.  To  get  the  limit  (4.6),  use  Theorem  3. 

Fix  f(»)  6  tf^’3.  T^e  metll0t*  getting  and  using  the  fe,N(*)  (written 
here  as  fE(*)>  for  notational  simplicity)  is  very  similar  to  that  for 
continuous  parameter  case.  We  start  by  calculating  Aef (uE,^(ne)) ,  and 
successively  average  out  the  'noise  terms, '  except  that  the  fE  are 
defined  by  sums  rather  than  integrals.  More  detail  on  the  method  for 
this  and  related  DPLL's  in  [13],  and  details  of  similar  approximations 
for  other  scaled  and  interpolated  discrete  parameter  processes  can  be 
found  in  [9] ,  [19] . 

First,  we  calculate  A  f(Un’  «n e)  (discrete  parameter  form).  Let 

£  £ 

En ( • )  =  expectation  conditioned  on  W(t),  s(t),  t  s  time  at  which 

is  first  known. 

eAef(UE*N,ne)  =  eft(UE,N,ne)  +  O(c2)-e^(UG'N,nc)0U^N  bN  (U^’N) 

+  /e  f  (U£''N,ne)bM(Ue’N)EeCe(Xe,1,,Ae’N)  (4.7) 

uv  n  N  n  n  n  n-1  n 

f  (UE,N,ne)  —  w  v  m  9  m 

♦  e  -  b2  e,N  c  c,N  c.N  )2  +  0c,N 

2  N  n  nv  n  n-1  n  '  In 


The  ,  a  remainder  in  the  truncated  Taylor  expansion, satisfies 

0E,N  =  0(e3/2)Ee[l  ♦  |e£(AE,!|,,Ae’N)  |3]  . 

In  n  1  n  n-1  n  1  ‘ 


Using  the  properties  of  the  Wiener  process,  for  each  t  <  «, 


lim  sup  |0e’N/e| 
e-K)  nest 

lim  sup  EiOE’N/e| 
e-*0  nest  n 


=  0  w.p. 1 , 


0 


(4.9) 


2S 


All  the  {0!^}  introduced  below  satisfy  (4.9)  for  each  N. 

Only  the  first  and  third  terms  on  the  right  of  (4.7)  are  part  of 

the  limit  operator  e(3/.  + A)f(U£,N,ne)  (for  U£'^  c  SM) .  The  rest  are 

ot  n  n  w 

either  negligible  or  must  be  averaged  out.  Henceforth,  drop  the  N 

superscript  on  U£’^,  A£’^.  The  bounds  on  the  error  terms  are  valid  for 

each  {Ue>^,  e > 0)  as  required  by  Theorem  3,  but  not  necessarily  for 
°  2 
(U£,  c  >  0i .  We  use  the  form  f£(ne)  =  f(Ue,ne)  +  £  f£(ne),  where  it 

n  i=0  1 

will  be  true  that  (each  t  >  0) 


lim  sup  }fC(ne) 
e-K)  nest  1 


w.p.l 


1  im  sup  E | f . (ne) 
e+0  nest 


(4 .10) 


To  average  out  the  f  term  in  (4.7),  introduce  the  first 
perturbation  f£(nc)  =  fo^Un’ne^’  w^ere 


e  f  (U,ne)  , 
uu  .  2. 


fe(U>ne)  -  bJ(U)  l  .*;))  21 

j=n 


e  e 

The  are  taken  as  parameters  in  calculating  all  expectations. 

Due  to  A  s  1/4,  and  to  the  properties  of  the  Wiener  process  W(>)  and 
of  {  sn>,  all  the  terms  in  the  sum  are  zero  except  the  lowest  (since 
E  (  )  =  E(  )  for  the  other  terms).  Now 

eAtf£(U£,ne)  =  -  (5 th  term  of  (4.7))  +  terms  satisfying  (4.9) 

ef  (U£,ne)  ,  , 

,  - b2(UC)E5e(Ae  ,,Ae)2 

2  N  n  nl  n-1  n 


The  last  component  yields  the  last  term  of  the  variance  v  in  (4.6), 


To  average  out  the  JZ  term  in  (4.7)  use 


ff(ne) 


/e  f  (UE,ne)b..(UE)  7  Ee£e(AE  Ae) 
u  n  N  n  . L  n  i  n-1  n 
j=n 

/e  f  (Ue,ne)bkI(Ue)EetE(AE  ,  ,AC)  . 
u1  n’  Nv  n'  n  n  n-1’  n' 


We  can  write 

eAEfE(ne)  =  -fE(ne)  +  0En 

+  iZ  EEb  (UE  ,)f  (UE  .  ,n c)C£  ,  ( A  ,A  .)  . 

n  n  +  1  uv  n+1  '  n+1  n’  n+1 

The  last  term  can  be  written  as 


JZ  Ee(f  (UE,ne)b  (UE))  (UE  ,-UE)^E  ,(AE,AE  , )  +  0E 
n1-  ir  n’  N  n  u  n  +  1  n  n  +  1  n  n+1  3n 


(4.11) 


=  e  (f  (UE,ne)bKi(UC))  EE  £  ,(AE,AE)  £E(AE  ,  ,AE)  ♦  0E 
^  u  n  N  n  Ju  n  n+lv  n'  n  n  n-1  n  4n 


This  term  is  neither  negligible  nor  part  of  cAf(UE) ,  and  so  it  needs  to 
be  averaged  further.  This  is  done  via  the  last  perturbation  fE(ne) : 


c(f,(u',„e)bN(u'))u  l 

j=n 


ESj+l^Xn^Xn-l’Xn» 


Mn  ) 


eAEfE(ne)  can  be  shown  to  equal  0E^  -  (4.11)  ♦  |  (fu(UE,ne)bN(UE)  )  x 
(first  component  of  variance  in  (4.b)).  The  constructed  fE(ne) 

can  be  shown  to  satisfy  the  requirements  of  Theorem  3,  where  the  operator 
A  is  that  of  (4.6).  Also,  the  fE(nc)  can  be  used  in  Theorem  2  to 
yield  tightness. 
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